PREFACE 


Research projects are neither conceived in a vacuum nor con- 
ducted in one; like most endeavors, they are emotional as well as 
rational undertakings. This preface is intended to restore the 
study which follows to the context--historical, conceptual, pèr- 
sonal--from which it was generated. Some readers of early drafts 
have contended that the report is an ideological tract rather than 
a scientific document; and some’ of these same readers, as editors, 
have sought to assist the authors through substitution of adjectives 
less emotional than those originally used and by deletion of whole 
passages (usually confessional or accusatory passages) which they 
found irrelevant and/or inappropriate. If the study is permeated 
with an ideological warp, the taint can hardly be removed by extir- 
pating from the report only the most obvious evidence that this is 
so; and we have consequently resisted "improvements" that would 
protect us from the reader or vice versa. It is likely that all, 
including our most severe critics, can agree that the greatest 
danger is not that we may mislead our reader, but that we may bore 
him. 


In late 1965, when I first became aware of new California 
Penal Code Section 2943, Paul Takagi and I were completing data 
collection for a study which involved presenting parole agents with 
incident reports and asking their recommendations for case dispo- 
sition--return to prison or continuation in the community. We had 
chosen this design for two main reasons. Earlier studies had shown 
large differences in actual rates of return among offices and Adult 
Authority decisions nearly always agreed with parole agent recommen- 
dations. These phenomena might reflect merely that, although the 
criteria for return to prison were clear and unambiguous, some 
offices received worse parolees than others. If we were to present 
all agents with the same test cases upon which to make recommenda- 
tions, and differences among offices in recommendation patterns were 
found, and such differences corresponded with differences in actual 
office violation rates, then we might conclude both that the 
decision criteria were vague and that the Adult Authority tended to 
rubber-stamp agent recommendations--conclusions which corresponded 
with our own preconceptions of the state of affairs. Further, we 
believed that agents' case recommendations were a function of their 
own backgrounds and their general attitudes toward parolees and the 
agency. We had developed questionnaire items for a’ oh aes designed 
to investigate these problems. 


Nearly a year had elapsed between submission of the proposal 
for that study and the grant of permission to undertake it. A great 
deal of negotiation and discussion (sometimes acrimonious) had 
intervened; and most parties, certainly including ourselves, had 
grown defensive--a fact of considerable importance to the design of 
the subsequent study which is reported in this paper. The dispute 
surrounding the first study had centered largely on the issues of 
whether there were not other’ tasks of higher priority,’ whether the 
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agents might be threatened or demoralized by the questionnaire items, 
whether the study had any practical--as opposed to academic-- 
relevance, and whether the researchers were too biased in their 
point of view. 


‘The data collected in this study clearly indicated large’ dit- 
ferences among, agents and among offices in recommendation patterns , 
on the, test cases. When these findings were presented to adminis- 
trators in the Department of Corrections,.we were met with. two 
arguments indicating that, these findings. were invalid. First, we 
were dealing, with an artificial decision, ‘situation. in which agents 
could feel less, committed. to. or accountable for the consequences of 
their decisions than was the case with their. real decisions--a lessen- 
ing of restraints which might yield more diversity; and second, the 
cases we had employed were not representative of those typically en- 
countered but were more marginal and, therefore, more likely to pro-. 
mote uncertainty and disagreement. The critical test of whether 
these, arguments had relevance or merit involved checking the pattern 
of decisions on the test cases with actual violation rates. Since 
many.,of the offices were recent in origin, it was. quite some time 
before an adequate cohort could be established. In the meantime, it 
was important to me to refute or minimize these arguments since they 
were being, employed to discount the implications of the study. The 
question of Marginality could.be handled easily enough by a re-test, 
upon an. agreeably representative set of cases; but this meant taking 
up more of the. agents' time.when they were already, according to 
administrators,.,"overresearched.". However, the. problem of artifi- 
ciality would,remain. Furthermore, it was not in accord with my own 
priorities about what.was vital research. I was personally preoccu- 
pied with two other problems. First, the test.cases had been i 
presented to our subjects in the form of a narrative report; and 
there was no satisfactory way of determining which features of those 
reports--which types of information or forms of assertion--had the 
most. bearing in shaping their recommendations. Methods for analysis 
of the. data, were developed and found unsuitable for this. purpose, 
and. some pilot interviews in which agents tried to report their 
decision "process" were not encouraging. Second, I believed that 
agents not only evaluated the information given in a report dif- 
ferently. from one another, but that, in actual. practice, they dif- 
fered,in a perhaps more important fashion--in the information they ; 
chose; to, include in a report. The crucial question was, does a 
synthesis of the information generate the recommendation, or does 
the agent's conclusion; generate the information he. records--is he a 
rationalist or a rationalizer? z 


, Experiments could be designed.to examine both these matters. 
However, all possibilities imagined would involve considerable in- 
vestment of parole.agent time as research, subjects; and the studies 
would be likely to be more, rather than less “artificial."., I began 
to think now of moving closer to: the. real situation rather than cre- 
ating a. special one. and of a study which would: not only involve no 
extra expenditure of effort on the parole agent's. part, ‘put which , 
would also not ke perceived by him as a research project and 
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therefore not alter his usual way of behaving. The direction of my 
thinking was toward sampling and subjecting to content analysis vio- 
lation reports from the mainstream of actual agency business. The 
choice of such an approach had the disadvantage, however, of sacri- 
ficing those research controls inherent in the "standard cases to 
different agents for standard decision" model. 


There was still another extremely important issue which we 
could not long afford to disregard. The first study was directed 
primarily at reliability or equity in case decisions and was an 
attempt to explain variability as a function of the decisi6én-makers. 
It could not concern itself directly with the guestion of.validity 
or rectitude of the decisions. In the absence of equity--the 
assurance that a parolee's chance of being returned to prison de- 
pends on his own characteristics and behavior rather than those of 
whichever agent is responsible for his case--the matter of rectitude 
is problematic. Yet, even if there were equity, there is no 
assurance of :rectitude--the parolee might be consistently disposed 
of by all decision-makers, but uniformly inappropriately. It was 
thus necessary to become concerned with the difficult problem of 
which is the better decision on a case, and the criteria for this 
judgment seemed’ to reside in the consequences of the decision as 
reflected in the subsequent outcome or performance of the case. 


Let us suppose that a violation incident has occurred and that 
a decision of return to prison or continuation on parole must be 
made. Unless'the' violation is 9f such gravity that return to prison 
(as a punitive action) is automatically dictated, the decision will 
depend heavily on a predictive assessment of whether the case, if 
maintained in the community on parole, would pass successfully to 
discharge or whether he would become involved in another perhaps 
more serious violation that could have been prevented by return at 
this time. There are two types of error to avoid--the unnecessary 
return to prison of a case that would successfully terminate and 
the continuing on parole of a case that will commit further serious 
offenses. Note that one of the two types of error has been expres- 
sed in the conditional tense. The correctness of the decision to 
return a case to prison with the intention of preventing or defer- 
ring opportunity for subsequent violation is difficult to assess 
since there is no direct and immediate way of knowing whether such 
violation would have occurred under conditions of opportunity. The 
mistakes in this direction are effectively buried. The decision to 
return to prison is, then, safe in two respects--offering safety 
from danger if it is correct and safety from discovery of error if 
it is wrong. If the decision to return a man to prison is equiva- 
lent to a prediction that he would again violate parole, the criti- 
cal test of adequacy would involve separating the evaluation from 
the decision--making the decision, then suspending it to provide 
opportunity for violation. However, permission to conduct such a 
test would be difficult to obtain in an agency whose mission is pub- 
lic protection. It was at this stage in thought that my attention 
was attracted to the new provision of the California Penal Code-- 
Section 2943. i 
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The decision to be made under 2943 PC concerned termination 
from or retention on parole. One means of evaluating such decisions 
would be to determine the extent of subseguent criminal behavior on 
the part of the cases. Since all cases, both those continued on 
parole and those discharged, would remain in the community and have 
opportunity for committing new offenses, performance outcomes for 
all cases could be obtained for a standard period subsequent to the 
decision. This was a research advantage of considerable appeal. 
Further, the only actuarial instrument in use by the Department for 
violation prediction depended on information relative to the 
parolee's pre-prison adjustment--information remote in time from the 
parole situation. Therefore, the mere description of cases eligible 
for consideration for discharge under 2943 PC, cases who had sur- 
vived two years on parole without suspension or cancellation, might 
be expected to provide useful additional indicators for incorporation 
into instruments designed to predict parole success. Another ad- 
vantage was that the very content of such a study would be likely to 
arouse less administrative resistance and elicit greater cooperation 
with Research. It was customary for agency personnel to lament the 
generally negative focus of the Research Division represented in its 
preoccupation with parolee failures and lack of attention to parolee 
successes and its preoccupation with "problems" and criticism of 
error, while failing to acknowledge or showing inability to discover 
favorable accomplishments and sincerity of effort. 


I also speculated that both the implementation of the new 
penal code section and the feedback of data regarding it might 
heighten agency and parole board morale and lessen the overall 
level of caution on parole decisions in general. I was especially 
interested in whether the new emphasis on early discharge in re- 
sponse to demonstrated rehabilitation would generalize so that 
other long-dormant means for such response (3024.5 PC) might become 
increasingly reactivated. Conceivably, the incentive for parolees 
in general (early discharge as a reward for a demonstrated period 
of good adjustment) might be sufficient to have some impact on the 
overall violation rate. Although such an effect would probably not 
be susceptible to test, its possibility helped convince me of the 
importance of the new section. 


The very large pool of eligible cases subject to immediate 
review created by the passage of the act had two important conse- 
quences. The first was the necessity for a special reviewing pro- 
cedure adequate to the rapid processing of the backlog. One feature 
of the solution was particularly intriguing--the creation of a two- 
member panel of hearing representatives, through which all cases 
would pass. This appeared to provide a far more uniform screen than 
the usual situation, where any pair (trio, if one considers the ab- 
sent ratifying member) of a large number of Adult Authority members 
and hearing representatives may be involved. Thus, there would be 
available a fairly reliable criterion for the judgments. I con- 
tacted the involved hearing representatives, was informed that they 
were developing explicit standards for the decision to discharge or 
continue, and requested a copy of these standards. Several reguests 


later, I had still not received one; and to the best of my knowledge, 
these standards were never committed to written form. The second 
consequence of the large backlog of eligible cases was the possi- 
bility, if a high proportion of these were discharged, of a signifi- 
cant decline in the size of the parole population. This possibility 
had prompted an auxiliary provision for change in the staffing 
"formula" (ratio of parolees to parole agent) used for funding the 
Parole Division. Nevertheless, concern about such a decline led to 
an early survey of the first decisions in order to provide some 
estimate of the overall extent of the decrease in the parole 
population. 


The memoranda relating to the implementation of 2943 PC speci- 
fied the areas of adjustment on which parole agents were to provide 
comments in their reports and upon which they were to base their 
recommendations for or against discharge from parole. These con- 
tent areas (e.g., arrest, employment) were those typically mentioned 
as important to parole reporting and decisions. The enumeration of 
these areas in the instructions to the parole agent appeared to pro- 
mote more comprehensive coverage (i.e., that each "base" would be 
touched) than was the case in violation reports, where agents often 
tended to become preoccupied with a few areas of adjustment and to 
omit any reference to others. The neglect in providing information 
whose omission would probably not be noticed but whose presence 
might influence a decision had been a source of some concern in my 
thinking about the narrative reporting procedure. It would also 
create a problem if one wished to analyze the content of such i 
reports into systematic coding categories because of the high num- 
ber of "indeterminate" codes that would result. Such problems 
appeared to be minimized by the instructions provided for the 
decision relating to discharge. The minimization of these problems 
increased the attractiveness of a study which would employ content 
analysis and which would be anchored in terms typically used and 
valued as relevant by operations rather than in esoteric categories 
developed only for research purposes. Research would, in this 
study, attempt to speak in operations’ own language. As mentioned 
earlier, a content-analysis approach was already under consideration 
for three reasons: as a possibility of isolating decision-relevant 
and outcome-relevant information variables; as a means for research 
without taxing parole agents’ time; and as having the advantage of 
sampling natural behavior as opposed to behavior under special or 
artificial conditions. The primary disadvantage of content analysis, 
compared to the analysis of responses to structured survey items, is 
the enormous demand it makes on time for development of workable 
categories and for actual coding from the narrative documents. 
Fortunately, the University of California School of Criminology was, 
at this very time, attempting to obtain Work Study placements for 
its students in relevant agencies; and coincidentally, the faculty 
member principally involved in these efforts was A. Lamont Smith, 
the person who had supplied primary impetus for the legislation 
which had culminated in Penal Code Section 2943. Negotiations were 
soon completed between the School of Criminology and the Department 
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of Corrections, and an adequate staff thereby became available for 
the contemplated project. There remained, however, the potentially 
Gevastating problem of securing sufficiently prompt authorization 
for the study itself to ensure that the now-available employees 
could be appropriately utilized. The lengthy delay in securing 
approval for our previous research study was a portent of what might 
happen and a source of dread to myself. We had now accumulated suf- 
ficient mass (research assistants) and sufficient momentum (i.e., 
pilot work and communication of interest) that it might be possible 
to convince the Department that the study was warranted or even 
inevitable. But I was not confident because all proposals for new 
research projects required passage through a recently formed depart- 
mental body which was composed of administrators who had nearly 
blocked our previous project and which I regarded as having been 
originally created for the purpose of obstructing or controlling that 
project.* My decision was to escape the necessary authorization by 
claiming that this was not, in fact, a new project, but merely a 
continuation of the old one. This claim, though defensible, must be 
confessed to have been a ruse. Since it went unchallenged, there is 
no way to determine whether the ruse was successful or merely 
unnecessary. 


In conversations with parole agents, it was soon apparent that 
divergent orientations were developing about the purpose of the new 
statute and about their role in its implementation. Some agents 
believed discharge was intended as a reward for extra-meritorious 
conduct and intended to recommend it for very few of their cases. 
Others, emphasizing the service aspect of the parole relationship, 
believéd that, even though a man misht be quite unlikely to get into 
future difficulty, they owed him the assistance they might still 
provide through further supervision. Some agents were doubtful that 
the standard for eligibility (two years without suspension or cancel- 
lation of parole) was an adequate screen for past misconduct or an 
adequate indicator of future conduct; then agents noted “blow-ups" 
of unlikely candidates in the past and intended to.discharge few. 


*A Research Advisory Council, with members drawn from outside 
experts in the field of social science, is also stipulated in the 
Administrative Manual of the Department of Corrections but ordi- 
narily exists: only as a paper entity and lacks real or formal power 
(see Appendix E). Both the council of outside social scientists 
(which meets semi-annually) and the internal committee of depart- 
mental administrators (which meets bi-monthly) are charged with 
making recommendations to the Director of Corrections, who has 
final authority. Only the internal committee, however, is involved 
in review of specific project proposals, including evaluation re- 
garding their scientific significance. As of this writing, the 
Research Advisory Council has been non-existent for several years. 
Mere resuscitation of this Council would accomplish little, however. 
Final authority for judgments about scientific significance should 
rest in that Council, and the Council's duties should include review 
and recommendation on research proposals. 
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Still other agents professed the belief that almost any case which 
met the standard of eligibility for reviewswas, in fact, ready for 
discharge and would be so recommended. Finally, yet another group 
of agents claimed to have no idea of an appropriate standard and to 
find no guidelines for such a standard in the instructions provided. 
These agents declared that they would recommend discharge on all 
eligible cases so that the Adult Authority would be more likely to 
scrutinize the recommendations and would be placed in a more respon- 
sible position for actually making these decisions. It seemed ob- 
vious that these differing positions would generate drastically 
different recommendation patterns; and since we were accustomed to 
decision processing which produced high levels of acceptance of 
initial recommendations, inequitable handling of the eligible cases. 
seemed aes aaa i 


By this time, some of the parameters of the decision system 
employed in reviewing the backlog of eligible cases (referred to as’ 
the "initial calendar" throughout this report) were becoming evi~ 
dent, shaping the nature of the study design and restructuring our 
opinions about the phenomena we were witnessing. It appeared that 
there would be about 1500 cases available for study. Since one of 
the variables in which we were most interested. (in continuity with 
the preceding study) was the office of origin of the reports, it 
was decided that all reports (an average of about 40 per parole 
office) would be coded for analysis. By comparison with the earlier 
guestionnaire and hypothetical decision data, it might then be 
feasible for‘us to document "real" correlates with our "artificial" 
material (i.e., patterns of actual reporting style related to 
response ‘patterns on attitudinal guestionnaire items or actual rec~ 
commendation patterns reflecting hypothetical recommendation 
patterns). Details of the development and application of the coding 
system" are discussed in the body of this report. 


The preliminary administrative survey for estimating the Hebek 
number of discharges had been completed and indicated that rela- 
tively few of the eligible cases--perhaps 25%--would actually be 
granted discharges. This seemed, on:the surface, conservative 
since the observation that the danger of parole violation is. great- 
est in the early months of parole and relatively slight thereafter 
is legend and was one of the justifications for enactment of the 
statute. Still, it might be reasonable, since only those cases with 
relatively long paroles--more serious cases--were affected by the 
statute, as a reflection of the fact that many less serious cases 
are routinely discharged in less than 24 months. Furthermore, some 
authorities have note that the early violation phenomenon is often 
exaggerated by failure to take into account the diminishing base 
(i.e., if 1000 parolees are released and 250 of them are returned to 
prison in the first year, 168 the second year, and 140 the third 
year, superficial interpretation fails to take into account that the 
violation rate is, constant rather than diminishing--25% of the: re-"” 
mainder rather.,than 25%, 19% and 14% of the total). 
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For one aspect of the study, that of correlating reported infor- 
mation factors with subsequent adjustment in the community, with the 
intention of developing better predictive indices, a relatively high 
rate of subsequent difficulty would be an advantage since it is dif- 
ficult to develop predictors for rare events. The causes of the low 
discharge rate were not, however, discoverable in the content of the 
case reports which we were engaged in coding, for most of the reports 
suggested rather stably adjusted parolees. The types of problems 
noted in these reports did not seem, ordinarily, to warrant much con- 
cern about future conduct. The agents were, in fact, in agreement 
with this assessment, recommending most of the cases for discharge; 
and these recommendations were being reversed at higher levels of 
review, particularly the hearing representative panel. The repre- 
sentatives were basing their judgments upon not only the parole 
agent's reports, but also a review of the entire case file. They 
were noting the reasons for this judgment on a standard agency form 
(CDC 1519) which was forwarded to the parole agent for communication 
to the parolee whose discharge was denied. The utilization of this 
form provided a novel source of detailed feedback; agents had ordi- 
narily been apprised only of the fact of the denial of their recom- 
mendations rather than offered a specific accounting of the reasons 
for denial.* As we examined these reasons, we were most struck by 
the frequent mention of extremely distant historical events derived 
from the case file rather than the current report (e.g., "This man 
has a history of antisocial conduct dating back to 1925"). We also 
grew concerned about the possible subversion of the intent of the 
statute; such material was of conceivable relevance to the determi- 
nation of the extent of a man's rehabilitation but rested more on 
the letter than the spirit of a statute addressed primarily to 
adjustment on the current parole. 


The reader, by now, is adequately acquainted with the con- 
siderations which prompted this investigation and some of the phantom 
concerns which warped its structure. It was not a detached or neu- 
tral undertaking. The researchers' biases are evident. Many of the 
following pages may be characterized as an attempt to persuade rather 
than an invitation to be convinced. Nevertheless, we find an im- 
portant message in the evidence and are confident that it will speak 
to others with essentially the same message. 


JAMES O. ROBISON 

Acting Assistant Professor 
University of California 
School of Criminology 
Berkeley 

July, 1969 


*This feedback, however, could not affect parole’ agents' handling 
of initial calendar cases since those were processed en masse. 


